User interface for ultrasound system

ABSTRACT

A user interface for an ultrasound system is provided. The ultrasound system includes the user interface having at least one user control member and a display having a plurality of virtual display elements displayed thereon when a virtual pointer is positioned over an image displayed on the display. A function controlled by the at least one user control member is determined based on a selected one of the plurality of virtual display elements.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application claims priority to and the benefit of the filing dateof U.S. Provisional Application No. 60/914,893, filed Apr. 30, 2007 for“PORTABLE 3D/4D ULTRASOUND,” which is hereby incorporated by referencein its entirety.

BACKGROUND OF INVENTION

This invention relates generally to ultrasound systems and, moreparticularly, to a user interface for controlling ultrasound imagingsystems, especially portable ultrasound medical imaging systems.

Ultrasound systems typically include ultrasound scanning devices, suchas ultrasound probes having transducers that allow for performingvarious ultrasound scans (e.g., imaging a volume or body). Theultrasound probes are typically connected to an ultrasound system forcontrolling the operation of the probes. The ultrasound system usuallyincludes a control portion (e.g., a control console or portable unit)that provides interfaces for interacting with a user, such as receivinguser inputs. For example, different buttons, knobs, etc. can be providedto allow a user to select different options and control the scanning ofan object using the connected ultrasound probe.

When using volume probes, for example three-dimensional (3D) orfour-dimensional (4D) probes, certain procedures may require multiplesteps and adjustments that can be controlled by different controllers,for example, using several rotatable control members (commonly referredto as rotaries) to adjust different settings. As a result, numerouscontrol members of each of several different types can be included aspart of the control portion. The control members are often modedependent such that each of the control members control a differentfunction or allow adjusting a different setting based on the mode ofoperation, for example, a visualization or rendering mode of operation.

As the size of ultrasound systems continue to decrease, the availablespace of the various controllers on the control portion is limited.Moreover, as processing power continues to increase, portable ultrasoundsystems, which have increasingly smaller footprints, often include anentire ultrasound system (e.g., processing components, etc.) embodiedwithin a housing having the dimensions of a typical laptop computer orsmaller. Thus, the same functionality is often now available in portablesystems as in larger systems. However, with the reduced space availablein a compact unit, the reduced number of available control members canmake it difficult or complex to control certain procedures or adjustdifferent parameters. In some instances, these portable ultrasoundsystems may not have enough controls to allow a user to control all ofthe operations that would otherwise be available on a larger system, butthat are still desirable in portable systems.

BRIEF DESCRIPTION OF INVENTION

In accordance with one embodiment, an ultrasound system is provided thatincludes a user interface having at least one user control member and adisplay having a plurality of virtual display elements displayed thereonwhen a virtual pointer is positioned over an image displayed on thedisplay. A function controlled by the at least one user control memberis determined based on a selected one of the plurality of virtualdisplay elements.

In accordance with another embodiment, an ultrasound system is providedthat includes an ultrasound volume probe for acquiring one ofthree-dimensional (3D) ultrasound data and four-dimensional (4D)ultrasound data and a portable control unit having a user interface anda display. The ultrasound volume probe is connected to the portablecontrol unit and wherein manipulation of one of the 3D ultrasound dataand 4D ultrasound data is provided by a single user control member ofthe user interface.

In accordance with yet another embodiment, a method for controlling anultrasound probe using a portable ultrasound system is provided. Themethod includes receiving a user input selecting one of a plurality ofvirtual display elements on a display on the portable ultrasound system.The method further includes configuring a user control member of theportable ultrasound system based on the received user input to controlan operation of the portable ultrasound system.

BRIEF DESCRIPTION OF SEVERAL VIEWS OF THE DRAWINGS

FIG. 1 is a block diagram of an ultrasound system formed in accordancewith an exemplary embodiment of the inventive arrangements.

FIG. 2 is a block diagram of the ultrasound processor module of FIG. 1formed in accordance with an exemplary embodiment of the inventivearrangements.

FIG. 3 is a top perspective view of a portable ultrasound imaging systemformed in accordance with an exemplary embodiment of the inventivearrangements having at least one reconfigurable user input member.

FIG. 4 is a top plan view of a user interface of the portable ultrasoundimaging system of FIG. 3.

FIG. 5 is an elevation view of a backend of the portable ultrasoundimaging system of FIG. 3.

FIG. 6 is a side elevation view of the portable ultrasound imagingsystem of FIG. 3.

FIG. 7 is a perspective view of a case for the portable ultrasoundimaging system of FIG. 3.

FIG. 8 is a perspective view of a movable cart that is capable ofsupporting the portable ultrasound imaging system of FIG. 3.

FIG. 9 is a top view of a hand carried or pocket-sized ultrasoundimaging system formed in accordance with an exemplary embodiment of theinventive arrangements having at least one reconfigurable user inputmember.

FIG. 10 is a screenshot of a display illustrating a plurality of virtualdisplay elements displayed in accordance with an exemplary embodiment ofthe inventive arrangements.

FIG. 11 is another screenshot of a display illustrating a plurality ofvirtual display elements displayed in accordance an exemplary embodimentof the inventive arrangements.

FIG. 12 is another screenshot of a display illustrating a plurality ofvirtual display elements displayed in accordance with an exemplaryembodiment of the inventive arrangements.

FIG. 13 is another screenshot of a display illustrating a plurality ofvirtual display elements displayed in accordance with an exemplaryembodiment of the inventive arrangements.

FIG. 14 is another screenshot of a display illustrating a plurality ofvirtual display elements displayed in accordance with an exemplaryembodiment of the inventive arrangements.

FIG. 15 is another screenshot of a display illustrating a plurality ofvirtual display elements displayed in accordance with an exemplaryembodiment of the inventive arrangements.

FIG. 16 is another screenshot of a display illustrating a plurality ofvirtual display elements displayed in accordance with an exemplaryembodiment of the inventive arrangements.

FIG. 17 is another screenshot of a display illustrating a plurality ofvirtual display elements displayed in accordance with an exemplaryembodiment of the inventive arrangements.

FIG. 18 is another screenshot of a display illustrating a plurality ofvirtual display elements displayed in accordance with an exemplaryembodiment of the inventive arrangements.

FIG. 19 is another screenshot of a display illustrating a plurality ofvirtual display elements displayed in accordance with an exemplaryembodiment of the inventive arrangements.

FIG. 20 is another screenshot of a display illustrating a plurality ofvirtual display elements displayed in accordance with an exemplaryembodiment of the inventive arrangements.

DETAILED DESCRIPTION OF VARIOUS PREFERRED EMBODIMENTS

The foregoing summary, as well as the following detailed description ofcertain embodiments of the inventive arrangements, will be betterunderstood when read in conjunction with the appended drawings. To theextent that the figures illustrate diagrams of the functional blocks ofvarious embodiments, the functional blocks are not necessarilyindicative of the division between hardware circuitry. Thus, forexample, one or more of the functional blocks (e.g., processors ormemories) may be implemented in a single piece of hardware (e.g., ageneral purpose signal processor or random access memory, hard disk, orthe like). Similarly, the programs may be stand alone programs, may beincorporated as subroutines in an operating system, may be functions inan installed software package, and the like. It should be understoodthat the various embodiments are not limited to the arrangements andinstrumentality shown in the drawings.

As used herein, an element or step recited in the singular and proceededwith the word “a” or “an” should be understood as not excluding pluralof said elements or steps, unless such exclusion is explicitly stated.Furthermore, references to “one embodiment” of the inventivearrangements are not intended to be interpreted as excluding theexistence of additional embodiments that also incorporate the recitedfeatures. Moreover, unless explicitly stated to the contrary,embodiments “comprising” or “having” an element or a plurality ofelements having a particular property may include additional suchelements not having that property.

It should be noted that although the various embodiments may bedescribed in connection with an ultrasound system, the methods andsystems described herein are not limited to ultrasound imaging. Inparticular, the various embodiments may be implemented in connectionwith different types of medical imaging, including, for example,magnetic resonance imaging (MRI) and computed-tomography (CT) imaging.Further, the various embodiments may be implemented in other non-medicalimaging systems, for example, non-destructive testing systems.

Exemplary embodiments of ultrasound systems provide a user interface foran ultrasound system. A plurality of virtual display elements (e.g.,display icons) are selectable by a user to change the functioncontrolled by a particular user control member. The selection of thevirtual display elements reconfigures one or more of the user controlmembers for controlling certain parameters, settings, etc. based on theselected virtual display element.

FIG. 1 illustrates a block diagram of an ultrasound system 20 formed inaccordance with various embodiments of the inventive arrangements. Theultrasound system 20 includes a transmitter 22 that drives an array ofelements 24 (e.g., piezoelectric crystals) within a transducer 26 toemit pulsed ultrasonic signals into a body or volume. A variety ofgeometries may be used, and the transducer 26 may be provided as partof, for example, different types of ultrasound probes. For example, theultrasound probe may be a volume probe such as a three-dimensional (3D)probe or a four-dimensional (4D) probe wherein the array of elements 24can be mechanically moved. The array of elements 24 may be swept orswung about an axis powered by a motor 25. In these embodiments,movement of the array of elements 24 is controlled by a motor controller27 and motor driver 29. However, it should be noted that the ultrasoundsystem 20 may have connected thereto an ultrasound probe that is notcapable of mechanical movement of the array of elements 24. In suchembodiments, the motor controller 27 and motor driver 29 may or may notbe provided and/or may be deactivated. Accordingly, the motor controller27 and motor driver 29 are optionally provided.

The emitted pulsed ultrasonic signals are back-scattered from structuresin a body, for example, blood cells or muscular tissue, to produceechoes that return to any of the elements 24. The echoes are received bya receiver 28. The received echoes are provided to a beamformer 30 thatperforms beamforming and outputs an RF signal. The RF signal is thenprovided to an RF processor 32 that processes the RF signal.Alternatively, the RF processor 32 may include a complex demodulator(not shown) that demodulates the RF signal to form IQ data pairsrepresentative of the echo signals. The RF or IQ signal data may then beprovided directly to a memory 34 for storage (e.g., temporary storage).

The ultrasound system 20 also includes a processor module 36 to processthe acquired ultrasound information (e.g., RF signal data or IQ datapairs) and prepare frames of ultrasound information for display on adisplay 38. The processor module 36 is adapted to perform one or moreprocessing operations according to a plurality of selectable ultrasoundmodalities on the acquired ultrasound information. Acquired ultrasoundinformation may be processed in real-time during a scanning session asthe echo signals are received. Additionally or alternatively, theultrasound information may be stored temporarily in the memory 34 duringa scanning session and processed in less than real-time in a live oroff-line operation. An image memory 40 is included for storing processedframes of acquired ultrasound information that are not scheduled to bedisplayed immediately. The image memory 40 may comprise any known datastorage medium, for example, a permanent storage medium, removablestorage medium, etc.

The processor module 36 is connected to a user interface 42 thatcontrols operation of the processor module 36 as explained below in moredetail and is configured to receive inputs from an operator. The display38 includes one or more monitors that present patient information,including diagnostic ultrasound images to the user for review,diagnosis, and/or analysis. The display 38 may automatically display,for example, one or more planes from a 3D ultrasound data set stored inthe memory 34 or 40. One or both of the memories 34, 40 may store 3Ddata sets of the ultrasound data, where such 3D data sets are accessedto present 2D and 3D images. For example, a 3D ultrasound data set maybe mapped into the corresponding memory 34 or 40, as well as one or morereference planes. The processing of the data, including the data sets,is based, at least in part, on user inputs, for example, user selectionsreceived at the user interface 42.

The display 38 also may display one or more virtual display elements 50that are selectable by a user and as described in more detail below.Based on the selection of a virtual display element 49, one or morecorresponding controls of the user interface 42, for example, theoperations controlled by a trackball and/or the like (not shown) may bereconfigured.

In operation, the ultrasound system 20 acquires data, for example,volumetric data sets by various techniques (e.g., 3D scanning, real-time3D imaging, volume scanning, 2D scanning with transducers havingpositioning sensors, freehand scanning using a voxel correlationtechnique, scanning using 2D or matrix array transducers, etc.). Thedata may be acquired by mechanically moving the array of elements 24 ofthe transducer 26, for example, by performing a sweeping type of scan.The transducer 26 also may be moved manually, such as along a linear orarcuate path, while scanning a region of interest (ROI). At each linearor arcuate position, the transducer 26 obtains scan planes that arestored in the memory 34.

FIG. 2 illustrates an exemplary block diagram of the processor module 36of FIG. 1. The processor module 36 is illustrated conceptually as acollection of sub-modules, but it may also be implemented utilizing anycombination of dedicated hardware boards, digital signal processors(DSPs), processors, etc. Alternatively, the sub-modules of FIG. 2 may beimplemented utilizing an off-the-shelf PC with a single processor ormultiple processors, with functional operations distributed between theprocessors. As a further option, the sub-modules of FIG. 2 may also beimplemented utilizing a hybrid configuration, in which certain modularfunctions are performed utilizing dedicated hardware, while theremaining modular functions are performed utilizing an off-the-shelf PCand/or the like. The sub-modules also may be implemented as softwaremodules within a processing unit.

The operations of the sub-modules illustrated in FIG. 2 may becontrolled by a local ultrasound controller 50 or by the processormodule 36. The sub-modules 52-68 perform mid-processor operations. Theultrasound processor module 36 may receive ultrasound data 70 in one ofseveral forms. In the embodiment of FIG. 2, for example, the receivedultrasound data 70 constitutes IQ data pairs representing the real andimaginary components associated with each data sample. The IQ data pairsare provided, for example, to one or more of a color-flow sub-module 52,a power Doppler sub-module 54, a B-mode sub-module 56, a spectralDoppler sub-module 58, and an M-mode sub-module 60. Other sub-modulesmay also be included, such as an Acoustic Radiation Force Impulse (ARFI)sub-module 62, a strain sub-module 64, a strain rate sub-module 66, aTissue Doppler (TDE) sub-module 68, among others.

Each of sub-modules 52-68 are configured to process the IQ data pairs ina corresponding manner to generate color-flow data 72, power Dopplerdata 74, B-mode data 76, spectral Doppler data 78, M-mode data 80, ARFIdata 82, echocardiographic strain data 84, echocardiographic strain ratedata 86, and tissue Doppler data 88, all of which may be stored in amemory 90 (or memory 34 or image memory 40 shown in FIG. 1) temporarilybefore subsequent processing. The data 72-88 may be stored, for example,as sets of vector data values, where each set defines an individualultrasound image frame. The vector data values are generally organizedbased on the polar coordinate system.

A scan converter sub-module 92 accesses and obtains from the memory 90the vector data values associated with an image frame and converts theset of vector data values to Cartesian coordinates to generate anultrasound image frame 93 formatted for display. The ultrasound imageframes 93 generated by the scan converter sub-module 92 may be providedback to the memory 90 for subsequent processing or may be provided tothe memory 34 or image memory 40.

Once the scan converter sub-module 92 generates the ultrasound imageframes 93 associated with the data, the image frames may be restored inthe memory 90 or communicated over a bus 96 to a database (not shown),the memory 34, the image memory 40, and/or to other processors (notshown).

A 2D video processor sub-module 94 may be used to combine one or more ofthe frames generated from the different types of ultrasound information.For example, the 2D video processor sub-module 94 may combine differentimage frames by mapping one type of data to a gray map and mapping theother type of data to a color map for video display. In the finaldisplayed image, the color pixel data is superimposed on the gray scalepixel data to form a single multi-mode image frame 98 that is againre-stored in the memory 90 or communicated over the bus 96. Successiveframes of images may be stored as a cine loop in the memory 90 or memory40 (shown in FIG. 1). The cine loop represents a first in, first outcircular image buffer to capture image data that is displayed inreal-time to the user, such as one or more heart cycles. The user mayfreeze the cine loop by entering a freeze command at the user interface42. The user interface 42 may include, for example, a keyboard, mouse,trackball, and/or all other input controls associated with inputtinginformation into the ultrasound system 20 (shown in FIG. 1), which inputcontrols may be reconfigured automatically based on selection of avirtual display element 49 (shown in FIG. 1) by the user.

A 3D processor sub-module 100 is also controlled by the user interface42 and accesses the memory 90 to obtain spatially consecutive groups ofultrasound image frames (that may be acquired, for example, by asweeping ultrasound scan) and to generate three dimensional imagerepresentations thereof, such as through volume rendering or surfacerendering algorithms, as are known. The three-dimensional images may begenerated utilizing various imaging techniques, such as ray-casting,maximum intensity pixel projection, and/or the like. Additionally, thethree-dimensional images may be displayed over time, thereby providingfour-dimensional operation, as is known.

Various embodiments of the inventive arrangements can also beimplemented in a miniaturized ultrasound imaging system, for example, aportable ultrasound imaging system 110 as shown in FIG. 3. The portableultrasound imaging system 110 may be, for example, a Voluson i compact4D ultrasound system available from G.E. Healthcare in Waukesha, Wis.The portable ultrasound imaging system 110 controls a probe (not shown)connected to the portable ultrasound imaging system 110 via a probeconnector 112 that may be locked to the portable ultrasound imagingsystem 110 using a probe locking handle 114. The user interface 42includes a plurality of user inputs and/or controls, which may be ofdifferent types, and are configured to receive commands from a user oroperator. For example, the user interface 42 may include a plurality of“soft” buttons 116, for example, toggle buttons and a keyboard 118, forexample, an alphanumeric keyboard. Additionally, a functional keyboardportion 120 may be provided that includes other user selectable buttonsand controls. Other user controls also may be provided, such as atrackball 122 having a trackball ring 124 and a plurality of associatedbuttons 126, which may be activated by the fingers of a user whenoperating the trackball 126. A plurality of sliding control members 128(e.g., time control gain potentiometers) may also be provided, forexample, adjacent the keyboard 118.

The portable ultrasound imaging system 110 also includes a display 130,for example, an integrated LCD display with a display latch 132 providedto lock the display 130 to the user interface 42. A power button 134 isprovided to power on and off the portable ultrasound imaging system 110.The portable ultrasound imaging system 110 with the user interface 42and the display defines a portable control unit.

It should be noted that as used herein, “miniaturized” generally meansthat the ultrasound system 110 is a handheld or hand-carried deviceand/or is configured to be carried in a person's hand, pocket,briefcase-sized case, backpack, and/or the like. For example, theultrasound system 110 may be a hand-carried device having a size of atypical laptop computer, for instance, having dimensions ofapproximately 2.5 inches in depth, approximately 14 inches in width, andapproximately 12 inches in height. The ultrasound system 110 may weighabout ten pounds or less, and is thus easily portable by the operator.The display 130 is configured to display, for example, a medical imageand virtual display elements, as described below.

It further should be noted that ultrasonic data from the portableultrasound imaging system 110 may be sent to an external device (notshown), such as a printer or display, via a wired or wireless network(or direct connection, for example, via a serial or parallel cable orUSB port). In some embodiments, the external device may be a computer ora workstation having a display. Alternatively, the external device maybe a separate external display or a printer capable of receiving imagedata from the portable ultrasound imaging system 110 and of displayingor printing images that may have greater resolution than the display130.

With particular reference to the user interface 42, and as shown in moredetail in FIG. 4, a plurality of user controls may be provided as partof the user interface 42. For example, “soft” buttons 116 may include afirst menu button 140, a second menu button 142, a third menu button144, and a fourth menu button 146, each capable of movement in fourdirections. A plurality of imaging buttons 148 may also be provided toselect different imaging functions or operations. A plurality of modeselection buttons 136 also may be provided to select different scanningmodes, for example, 2D, 4D, pulsed wave doppler (PW), color flow mode(CFM), etc. The functional keyboard portion 120 also includes other userselectable buttons and controls, such as buttons that allow forobtaining saved information, storing information, manipulatinginformation or displayed images, calculating measurements relating todisplayed images, changing a display format, etc.

The portable ultrasound imaging system 110 also includes internal andexternal connections on a back end 160 as shown in FIG. 5 and on a sideportion 170 as shown in FIG. 6. For example, the back end 160 mayinclude a VGA connector 162 (for connection, for example, to an externalmonitor), an RGB connector 164 (for connection, for example, to aprinter) and a power supply input 166. A network connector 168, forexample, an Ethernet LAN input/output also may be provided and one ormore USB connectors 169 may be provided. On the side portion 170, andfor example, a probe connection 172 for connection to a probe, may beprovided, and the probe locking handle 114 is provided. It should benoted that different or additional connectors may be provided as desiredor known, for example, based on the scanning applications for theportable ultrasound imaging system 110.

The portable ultrasound imaging system 110 also may be transported,stored, or operated in a case 180, as shown in FIG. 7. The case 180 maybe, for example, a padded case to protect the portable ultrasoundimaging system 110.

The portable ultrasound imaging system 110 also may be configured formounting to or to be supported by a moveable base 190, for example, amovable cart as shown in FIG. 8. The moveable base 190 includes asupport portion 192 for receiving and supporting the portable ultrasoundimaging system 110 and a tray portion 194 that may be used, for example,to store peripherals. The movable base 190 also may include one or moreprobe holders 196 for supporting and holding therein one or moreultrasound probes, for example, one probe connected to the portableultrasound imaging system 110 and other probes configured to beconnected to the portable ultrasound imaging system 110. A foot rest 198also may be provided. Accordingly, the portable ultrasound imagingsystem 110 may be configured to appear like a console-based typeultrasound imaging system.

However, it should be noted that the various embodiments may beimplemented in connection with ultrasound systems having different sizesand shapes. For example, a hand carried or pocket-sized ultrasoundimaging system 200 may be provided as shown in FIG. 9. In such a system200, the display 130 and user interface 42 can form a single unit. Byway of example, the pocket-sized ultrasound imaging system 200 may be apocket-sized or hand-sized ultrasound system approximately 2 incheswide, approximately 4 inches in length, and approximately ½ inches indepth and/or weigh less than 3 ounces. The display 130 may be, forexample, a 320×320 pixel color LCD display (on which a medical image 210can be displayed). A typewriter-like keyboard 202 of buttons 203 mayoptionally be included in the user interface 42. It should be noted thatthe various embodiments may be implemented in connection with apocket-sized ultrasound system 200 having different dimensions, weights,and/pr power consumptions.

Multi-function controls 204 may each be assigned functions in accordancewith the mode of system operation. Therefore, each of the multi-functioncontrols 204 may be configured to provide a plurality of differentactions. Label display areas 206 associated with the multi-functioncontrols 204 may be included as necessary on the display 130. The system200 may also have additional keys and/or controls 208 for specialpurpose functions, which may include, but are not limited to “freeze,”“depth control,” “gain control,” “color-mode,” “print,” and “store.”

Various embodiments of the inventive arrangements provide virtualdisplay elements (e.g., display icons) that are selectable by a user tochange the function controlled by a particular user control. Theselection of the virtual display elements reconfigures one or more ofthe user controls for controlling certain parameters, settings, etc.based on the selected virtual display element. In general, and as shownin FIG. 10, a user is presented with a plurality of virtual displayelements 220 a-220 e that may be displayed, for example, on a screen222, such as the display 38 (shown in FIG. 1). The virtual displayelements 220 a-220 e are displayed on the screen 222 adjacent (e.g.,surrounding) or proximate an image that is selected by a user. Forexample, when a user places a virtual pointer 224 (e.g., virtualcross-hairs) over a particular image 225, the virtual display elements220 a-220 e are displayed on the screen 222. It should be noted that thevirtual display elements 220 a-220 e disappear once the image 225 is nolonger selected or the virtual pointer 224 is moved away from the image225 and another image 226 is selected or the virtual pointer 224 ismoved over that image or another user control member is activated (e.g.,depressed). However, the virtual display elements 220 a-220 e maycontinue to be displayed in connection with the image 225 for apredetermined period of time (e.g., 2 seconds) even after the image 225is no longer selected.

With the virtual display elements 220 a-220 e displayed on the screen222, a user may select one of the virtual display elements 220 a-220 e.Upon selecting one of the virtual display elements 220 a-220 e, thecorresponding function represented by that virtual display element 220a-220 e is now adjusted or controlled by one of the controls of the userinterface 42 (shown in FIG. 4), for example, the trackball 122.Accordingly, when a virtual display element 220 a-220 e is selected, theoperation of the trackball 122 is reconfigured and the control thereofremapped, for example, as shown in Table 1 below.

TABLE 1 Screen Ctrl Icon Meaning Rot X

Rotate around X-axis when in ref image A (respective axis in B, C, 3D).Rot Y

Rotate around Y-axis when in ref image A (respective axis in B, C, 3D).Rot Z

Rotate around Z-axis when in ref image A (respective axis in B, C, 3D).Parallel Shift

Shift in Z-direction. Curved Render Start

Move curved render start Move

Move the data around. Borders of — Can be selected to resize theRenderbox Renderbox Home3D

Switch 3D rendered image back to initial 3D position. Home3Dflat

Toggle between 3D view and flat 3D view of the rendered image.

Accordingly, and for example, if a particular virtual display element220 a is selected, which may be selected by using the trackball 122 tomove the virtual pointer 224 to the image 225 and pressing one of thebuttons 126 (shown in FIG. 4), then the trackball 122 is reconfigured tocontrol or adjust the parameter, function, etc. corresponding to thatvirtual display element 220 a, which, in the embodiment shown in Table1, is to control rotation around the X-axis of the image 225. Thus, theoperation of the trackball 122 is reconfigured to control or adjust theX-axis rotation. A user may then click one of the buttons 126 to returnthe trackball 122 to controlling movement of the virtual pointer 224 andallowing selection of one of the other virtual display elements 220b-220 e. Alternatively, another one of the buttons of the user interface42 may deselect the operation corresponding to a virtual display element220 a and allow the selection of one of the other virtual displayelements 220 b-220 e.

It should be noted that the virtual display elements 220 a-220 e may beconfigured as different icons and correspond to different function oroperations than those illustrated in Table 1. It also should be notedthat the selection of one of the virtual display elements 220 a-220 emay, instead of reconfiguring the trackball 122, reconfigure anotheruser control or the user interface 42 or an external user control (e.g.,a connected mouse).

Moreover, other information or selectable elements may be displayed onthe screen 222. For example, a plurality of selectable elements 230 maybe provided to allow for the selection of a particular visualizationmode.

Referring now to FIGS. 11-20 illustrating exemplary screenshots 232including the virtual display elements 220 a-220 e, a rendervisualization mode (which may be selected using the selectable elements230) for a 4D realtime acquisition is shown. Specifically, as shown inFIG. 11, the virtual pointer 224, illustrated as a mouse pointer, ismoved, for example, using the trackball 122 (shown in FIG. 4), over aside 240 of a render box 242 (identifying the region of the image 244 tobe rendered). The side 240 may be highlighted (e.g., highlighted by acolor) when the virtual pointer 224 is placed over the side 240. Whenthe side 240 is selected, the virtual display elements 220 a-220 d and220 f (e.g., icons) are displayed. It should be noted that the virtualdisplay element 220 e is not displayed in this screenshot, but it may bedisplayed in some embodiments.

As shown in FIG. 11, the virtual pointer 224 has now been placed overvirtual display element 220 f (the icon shaped as a dot) thatcorresponds to a curved render start function. When the virtual displayelement 220 f is selected, or when the virtual pointer 224 is moved overthe virtual display element 220 f, the virtual display element 220 f maybe highlighted (e.g., highlighted or shadowed in yellow). Once thevirtual display element 220 f is selected, the trackball 122 isreconfigured to adjust the curved render start function as shown in FIG.13. Once the virtual display element 220 f is selected, the virtualdisplay element 220 f may be highlighted differently (e.g., highlightedin a different color, such as red) and a curved render start portion 244of the render box 240 is displayed. It should be noted that once thevirtual display element 220 f is selected, the other virtual displayelements 220 a-220 d disappear, and when the trackball 122 is moved, thecurved render start portion 244 is changed, for example, curved asadjusted by the trackball 122 instead of straight as shown in FIG. 12.It should be noted that once the adjustment is complete, a user maypress any of the buttons 126 (shown in FIG. 4) and the other virtualdisplay elements 220 a-220 d appear again.

It also should be noted that a virtual representation 246 of thetrackball 122 may be displayed on the display 130 and indicate thefunctions corresponding to the trackball 122 and the buttons 126 in thecurrent active display mode.

As shown in FIG. 14, another side 248 (or border) of the render box 240may be selected and which reconfigures the functionality of thetrackball 122 to allow adjustment of the size of the render box 240. Theside 248 may be highlighted (e.g., highlighted in red) and all ofvirtual display elements 220 a-220 d and 220 f disappear. When thetrackball 122 is now moved, the size of the render box 240 is changed.For example, the render box 240 is now smaller in FIG. 14 than in FIG.11-13. It should be noted that once the adjustment is complete, a usermay press any of the buttons 126 (shown in FIG. 4) and the virtualdisplay elements 220 a-220 d and 220 f appear again.

In the screenshot 232 of FIG. 15, the virtual display element 220 a hasbeen selected and the other virtual display elements 220 b-220 d and 220f have disappeared. The selected virtual display element 220 acorresponds to a rotate around the y-axis, which now may be adjusted bythe trackball 122 that is reconfigured to control this operation. Theselected virtual display element 220 a may be highlighted (e.g.,highlighted in red) and when the trackball 122 is moved, the volume datadisplayed is rotated around or about the y-axis, with the content of thedisplayed images 244 and 245 changed accordingly. It should be notedthat once the adjustment is complete, a user may press any of thebuttons 126 (shown in FIG. 4) and the virtual display elements 220 b-220d and 220 f appear again.

In FIG. 16, the virtual pointer 224 has been moved over the image 245.When the virtual pointer 224 is moved over the image 245, a differentset of virtual display elements 220 a-220 d and now 220 g appear. Inparticular, the virtual display element 220 g now appears and isconfigured as a “house” icon. It should be noted that a render box 241may now appear on the image 245. The virtual display element 220 g whenselected changes the 3D display. In particular, as shown in FIG. 17, therendered image, specifically, the image 245 is now displayed at anangle, the render box 241 is displayed as a three-dimensional box andthe virtual display element 220 g changes shape, for example, the“house” icon is rotated. If the virtual display element 220 g is againselected, the image 245 will again appear as shown in FIG. 16 and theshape of the virtual display element 220 g will return to the “house”icon as shown in FIG. 16.

FIG. 18 illustrates a quad-view mode and the visualization mode nowshows sectional planes. The virtual pointer 224 is now shown as movedover a center dot 252 in the image 250 and the dot is marked, forexample, with a marker 254, such as cross-hairs that may be highlighted,for example, highlighted in yellow. The user may then select the marker254, which may, for example, change color to red and a move center dotfunction is now assigned to the trackball 122. All of the other virtualdisplay elements 220 a-220 d also disappear. When the trackball 122 ismoved, the center dot 252 is moved and the content of the image 250, aswell as the images 260 and 262 changed accordingly. It should be notedthat once the adjustment is complete, a user may press any of thebuttons 126 (shown in FIG. 4) and the virtual display elements 220 a-220d appear again.

As shown in FIG. 20, the virtual pointer 224 has been moved over theimage 260 and not over any of the virtual display elements 220 a-220 d.The virtual pointer 224 now has a different shape, for example, a handinstead of an arrow or pointer. In this mode, if one of the buttons 126is selected (e.g., pressed by a user), a move image functionality isselected and assigned to the trackball 122. When the trackball 122 ismoved, the image 260 is moved on the display.

Thus, a single user control member can be used to manipulate, forexample, 3D or 4D ultrasound data. For example, by assigning differentoperations to the single user control member based on selecting from aplurality of virtual display elements, the single user control member isreconfigured to control different operations or adjust differentsettings, parameters, etc.

It should be noted that the some (or all) of virtual display elements220 a-220 g may be displayed in different imaging modes, for example, atomographic ultrasound image (TUI) mode or a SonoVCAD mode. However,different virtual display elements corresponding to different operationsor functions may be displayed in addition to or instead of some or allof the virtual display elements 220 a-220 g. Also, it should be notedthat in some modes, only a specific image or images can be adjusted andaccordingly, the virtual display elements only appear when the virtualpointer 224 is moved over those images. It also should be noted thatonly a single image may be displayed instead of the multiple images asillustrated.

Accordingly, the various embodiments automatically reconfigure theoperation of a user control member (e.g., a trackball) based on aselected virtual display element such that the control operationsperformed by the user control member are remapped. The user controlmember is thereby used to adjust or control different functions based onthe virtual display element selected. In one embodiment, based on theselected virtual display element corresponding to a particular function,setting, parameter, etc., the movement of the user control member isremapped to, for example, allow the particular, setting, parameter, etc.to be adjusted or changed based on the movement of the user controlmember that has been remapped. For example, a table or database isaccessed and the corresponding motion of the user control member ismapped for the particular function, setting, parameter, etc. Thereafter,the relative movement of the user control member adjusts the particularfunction, setting, parameter, etc. corresponding to the selected virtualdisplay element.

At least one technical effect of the various embodiments of theinventive arrangements is automatically changing the control function oroperation of a user control member based on the selection of a virtualdisplay element. The user control member is reconfigured or reassignedto control or adjust a different operation or function based on theselected virtual display element.

Some embodiments of the inventive arrangements provide amachine-readable medium or media having instructions recorded thereonfor a processor or computer to operate an imaging apparatus to performone or more embodiments of the methods described herein. The medium ormedia may be any type of CD-ROM, DVD, floppy disk, hard disk, opticaldisk, flash RAM drive, and/or other type of computer-readable medium,and/or a combination thereof.

The various embodiments and/or components, for example, the processors,or components and controllers therein, may also be implemented as partof one or more computers or processors. Such a computer or processor mayinclude a computing device, an input device, a display unit, and/or aninterface, for example, for accessing the Internet. The computer orprocessor may include a microprocessor. The microprocessor may beconnected to a communication bus. The computer or processor may alsoinclude a memory. The memory may include Random Access Memory (RAM)and/or Read Only Memory (ROM). The computer or processor may furtherinclude a storage device, which may be a hard disk drive or a removablestorage drive, such as a floppy disk drive, optical disk drive, and/orthe like. The storage device may also be other similar means for loadingcomputer programs or other instructions into the computer or processor.

As used herein, the term “computer” may include any processor-based ormicroprocessor-based system, including systems using microcontrollers,reduced instruction set computers (RISC), application specificintegrated circuits (ASICs), logic circuits, and any other circuit orprocessor capable of executing the functions described herein. The aboveexamples are exemplary only and thus not intended to limit in any waythe definition and/or meaning of the term “computer.”

The computer or processor executes a set of instructions that are storedin one or more storage elements, in order to process input data. Thestorage elements may also store data or other information as desiredand/or needed. The storage element may be in the form of an informationsource or a physical memory element within a processing machine.

The set of instructions may include various commands that instruct thecomputer or processor as a processing machine to perform specificoperations, such as the methods and processes of the various embodimentsof the inventive arrangements. The set of instructions may be in theform of a software program. The software may be in various forms, suchas system software or application software. In addition, the softwaremay be in the form of a collection of separate programs, a programmodule within a larger program, or a portion of a program module. Thesoftware may also include modular programming in the form ofobject-oriented programming. The processing of input data by theprocessing machine may be in response to user commands, or in responseto results of previous processing, or in response to a request made byanother processing machine.

As used herein, the terms “software” and “firmware” are interchangeableand include any computer program stored in memory for execution by acomputer, including RAM memory, ROM memory, EPROM memory, EEPROM memory,and/or non-volatile RAM (NVRAM) memory. The above memory types areexemplary only and are thus not limiting as to the types of memoryusable for storage of a computer program.

It is to be understood that the above description is intended to beillustrative and not restrictive. For example, the above-describedembodiments (and/or aspects thereof) may be used in combination witheach other. In addition, many modifications may be made to adapt aparticular situation or material to the teachings of the inventivearrangements without departing from their scope. For example, theordering of steps recited in a method need not be performed in aparticular order unless explicitly stated or implicitly required (e.g.,one step requires the results or a product of a previous step to beavailable). While some of the dimensions and types of materialsdescribed herein are intended to define the parameters of the inventivearrangements, they are by not limiting and are exemplary embodiments.Many other embodiments will be apparent to those of skill in the artupon reviewing and understanding the above description. The scope of theinventive arrangements should, therefore, be determined with referenceto the appended claims, along with the full scope of equivalents towhich such claims are entitled. In the appended claims, the terms“including” and “in which” are used as the plain-English equivalents ofthe respective terms “comprising” and “wherein.” Moreover, in thefollowing claims, the terms “first,” “second,” and “third,” etc. areused merely as labels, and they are not intended to impose numericalrequirements on their objects. Further, the limitations of the followingclaims are not written in means-plus-function format and are notintended to be interpreted based on 35 U.S.C. § 112, sixth paragraph,unless and until such claim limitations expressly use the phrase “meansfor” followed by a statement of function void of further structure.

This written description uses examples to disclose the inventivearrangements, including the best mode, and also to enable any personskilled in the art to practice the invention, including making and usingany devices and/or systems and performing any incorporated methods. Thepatentable scope of the invention is defined by the claims and mayinclude other examples that occur to those skilled in the art. Suchother examples are intended to be within the scope of the claims if theyhave structural elements that do not differ from the literal language ofthe claims, or if they include equivalent structural elements withinsubstantial differences from the literal languages of the claims.

1. An ultrasound system, comprising: a user interface having at leastone user control member; and a display having a plurality of virtualdisplay elements displayed thereon when a virtual pointer is positionedover an image displayed on the display and wherein a function controlledby the at least one user control member is determined based on aselected one of the plurality of virtual display elements.
 2. Theultrasound system of claim 1, wherein the at least one user controlmember is configured to be operated to select one of the plurality ofvirtual display elements using the virtual pointer.
 3. The ultrasoundsystem of claim 1, wherein the at least one user control membercomprises a trackball.
 4. The ultrasound system of claim 1, wherein thedisplay is configured to display only the selected one of the virtualdisplay elements.
 5. The ultrasound system of claim 4, wherein thedisplay is configured to display the other display elements when one of(i) an adjustment using the at least one user control member iscompleted and (ii) a button corresponding to the user control member isactivated.
 6. The ultrasound system of claim 1, wherein the plurality ofvirtual display elements comprise icons representative of thecorresponding controlled function.
 7. The ultrasound system of claim 1,wherein the plurality of virtual display elements are displayed onlywhen the virtual pointer is positioned over an image that can bechanged.
 8. The ultrasound system of claim 1, wherein the plurality ofvirtual display elements are changed based on one of a mode of operationand a mode of visualization.
 9. The ultrasound system of claim 1,wherein the display automatically displays the plurality of virtualdisplay elements when the virtual pointer is positioned over the image.10. The ultrasound system of claim 1, wherein the virtual displayelements are displayed adjacent the image.
 11. The ultrasound system ofclaim 1, wherein the selected one of the plurality of virtual displayelements is highlighted.
 12. The ultrasound system of claim 1, whereinthe function controlled by the at least one user control membercomprises an adjustment.
 13. The ultrasound system of claim 1, whereinan icon representing the selected one of the plurality of virtualdisplay elements changes based on an input from the at least one usercontrol member.
 14. The ultrasound system of claim 1, wherein thedisplay is configured to display a virtual representation of the atleast one user control member along with at least one indicated functioncorresponding to at least one user control member and one or morebuttons associated with the at least one user control member.
 15. Theultrasound system of claim 1, further comprising: a portable ultrasoundunit including the user interface and the display.
 16. An ultrasoundsystem, comprising: an ultrasound volume probe for acquiring one ofthree-dimensional (3D) ultrasound data and four-dimensional (4D)ultrasound data; and a portable control unit having a user interface anda display, the ultrasound volume probe connected to the portable controlunit, and wherein manipulation of one of the 3D ultrasound data and 4Dultrasound data is provided by a single user control member of the userinterface.
 17. The ultrasound system of claim 16, wherein the singleuser control member comprises a trackball.
 18. The ultrasound system ofclaim 16, wherein the display is configured to display a plurality ofselectable virtual display elements and a type of manipulation providedby the single user control member is determined based on a selected oneof the plurality of selectable virtual display elements.
 19. Theultrasound system of claim 16, wherein the user interface does notinclude rotary controls and the manipulation is performed without theuse of the rotary controls.
 20. A method for controlling an ultrasoundprobe using a portable ultrasound system, comprising: receiving a userinput selecting one of a plurality of virtual display elements on adisplay on the portable ultrasound system; and configuring a usercontrol member of the portable ultrasound system based on the receiveduser input to control an operation of the portable ultrasound system.